Evaluating Class Membership Relations in Knowledge Graphs using Large Language ModelsBradley P. Allen, Paul T. Grothhttps://arxiv.org/abs/2404.17000 http…
Evaluating Class Membership Relations in Knowledge Graphs using Large Language ModelsA backbone of knowledge graphs are their class membership relations, which assign entities to a given class. As part of the knowledge engineering process, we propose a new method for evaluating the quality of these relations by processing descriptions of a given entity and class using a zero-shot chain-of-thought classifier that uses a natural language intensional definition of a class. We evaluate the method using two publicly available knowledge graphs, Wikidata and CaLiGraph, and 7 large lan…